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Abstract 

In this paper we study polynomial identity testing of sums of k read-once algebraic branching 
programs (Efe-RO-ABPs), generalizing the work of Shpilka and Volkovich [HE], who considered 
sums of k rcad-oncc formulas (Sfe-RO-formulas). We show that Efe-RO-ABPs are strictly more 
powerful than Sfc-RO-formulas, for any k < \n/2\, where n is the number of variables. Nev- 
ertheless, as a starting observation, we show that the generator given in [2] for testing a single 
RO-formula also works against a single RO-ABP. 

For the main technical part of this paper, we develop a property of polynomials called 
alignment. Using this property in conjunction with the hardness of representation approach of 
[HH], we obtain the following results for identity testing Efe-RO-ABPs, provided the underlying 
field has enough elements (more than kn'^ suffices): 

1. Given free access to the RO-ABPs in the sum, we get a deterministic algorithm that runs 
in time 0{k^n'^s) + n^^''\ where s bounds the size of any largest RO-ABP given on the 
input. This implies we have a deterministic polynomial time algorithm for testing whether 
the sum of a constant number of RO-ABPs computes the zero polynomial. 

2. Given black-box access to the RO-ABPs computing the individual polynomials in the sum, 
we get a deterministic algorithm that runs in time fc^rt'^*^'°sn) _|_ rPO^) _ 

3. Finally, given only black-box access to the polynomial computed by the sum of the k 
RO-ABPs, we obtain an n'^('^+^°^") time deterministic algorithm. 

Items 1. and 3. above strengthen two main results of .2^ (Theorems 2 and 3, respectively, 
for the case of non-preprocessed Efc-RO-formulas). 

1 Introduction 



In this paper we make contributions to the program of constructing increasingly more power- 
ful pseudo-random generators useful against arithmetic circuits. As argued by Agrawal [3J, this 
program is an approach towards resolving Valiant's Hypothesis, which states that the algebraic 
complexity classes VP and VNP are distinct. 

Central to this program is the PIT problem: given an arithmetic circuit C with input vari- 
ables xi,X2 . . . Xn over a field F, test if C(xi, X2, . . . , x„) computes the zero polynomial in the ring 
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¥[xi, X2, ■ ■ ■ Xn]- This is a well-studied algorithmic problem with a long history and a variety of 
connections and applications. See [1] for a recent survey. Efficient randomized algorithms were 
proposed independently by Schwartz [5] and Zippel [6]- Obtaining a deterministic algorithm for 
the problem seemed surprisingly elusive. 

It was originally Kabanets and Impagliazzo [7] who showed the strong connection between deran- 
domizing PIT and proving circuit lower bounds. They showed that giving a deterministic polyno- 
mial time (even subexponential time) identity testing algorithm means either that NEXP ^ P/poly, 
or that the permanent has no polynomial size arithmetic circuits. This was further strengthened 
in [3], where it was shown that giving a black-box derandomization of PIT implies that an explicit 
multilinear polynomial has no subexponential size arithmetic circuits. 

Since the seminal work of [7j, there has been a lot of attention and an impressive amount of 
progress in the area. Some of the special cases for which progress has been reported are: depth-2 
arithmetic formulas [H El [TO], depth-3 and depth-4 arithmetic circuits with bounded top fan- 
in im [T2I [TOl [T^ [T5| I16j . and non-commutative arithmetic formulas [TT]. In a surprising result, 
Agrawal and Vinay [H] showed that the black-box derandomization of PIT for only depth-4 circuits 
is almost as hard as that for general arithmetic circuits. 

Partly aimed at making progress towards an efficient deterministic PIT algorithm for multi- 
linear formulas, Shpilka and Volkovich [H [2] studied the arithmetic read-once formula model. An 
arithmetic read-once formula is given by a tree whose nodes are taken from {-|-, x}, and whose 
leaves are variables or field constants, subject to the restriction that each variables Xi is allowed to 
appear at most once. In their work, efficient black-box deterministic PIT algorithms are given for 
Efc-RO-formulas, for "moderate" k. 

We remark that due to a construction by Valiant [19j, given a RO-formula F of size s computing 
/, one can express / as a "read-once" determinantal expression / = det{M), where M is a 0{s)- 
dimensional matrix, whose entries are variables or field elements. In this, each variable Xi appears at 
most once in M. Identity testing read-once determinantal expressions, is an important special case 
of the PIT problem, as it is well-known that the bipartite perfect matching problem (BIPARTITE- 
PM) reduces to that form. Giving a black-box algorithm for testing such expressions has the 
potential of putting BIPARTITE-PM in NC, which is a prominent open problem in complexity 
theory regarding parallelizability [20 1 [2 H [22l [23] . 

1.1 Results 

We consider a generalization of the above mentioned RO-formulas, namely read-once algebraic 
branching programs (RO-ABPfl. An algebraic branching program (ABP) is a layered directed 
acyclic graph with two special vertices s and t. Each edge is assigned a weight, which is an element 
of X U F, where X is a set of variables. For a path in the graph its weight is taken to be the 
product of the weight on its edges. The ABP itself computes a polynomial which is the sum of the 
weights of all paths from s to t. The ABP is said to be read-once if each variable appears on at 
most one edge. A polynomial / G ¥[X] is called a RO-ABP-polynomial if there exists a RO-ABP 
which computes /. 

Due to [I9], if / can be computed by a RO-formula of size s, then / can be computed by a RO- 
ABP of size 0{s). However, RO-ABPs are strictly more powerful than RO-formulas. Appendix [Al 
shows a RO-ABP computing g = X1X2 + X2X3 -|- • • • -|- X2n-iX2n- Example 3.12 in [l] shows that 

^See Section [2] for a formal definition. 
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g can not be computed by a RO-formula, if n > 2. We remark that the RO-ABP model in not 
universal, e.g. for n > 3, ni<j<j<n ™ RO-ABP-polynomial (See Appendix iBl). By 

[19) . if / is computable by a RO-ABP of size s, then we can write / as a read-once determinantal 
expression / = det(M(x)), where M is a matrix of dimension 0{s). 

The results we will mention next make progress towards identity testing read-once determinantal 
expressions. This contributes to the program for separating VP and VNP mentioned in previous 
section (See e.g. [23] for a direct connection). 

Our first result is to show that the Shpilka- Volkovich generator (SV-generator) used in [2] 
for identity testing RO-formulas also provides a test for RO-ABPs. This generator has also very 
recently been applied to identity testing multilinear depth 4 circuits with bounded top fan- in [l6j. 
It is defined as follows: 

Let A = {ai,a2, ■ ■ ■ , C F be a set of size n. For every i G [n], let Ui{w) be the ith Lagrange 
interpolation polynomial on A. Then Ui{w) is a polynomial of degree n — 1 satisfying that Ui{aj) = 1 
if j = i and otherwise. For every i € [n] and k > 1, define 

Gl{yi,y2, ■ ■ .,yk,zi,Z2, ...,zk)= ^ Ui{yj)zj. 

and let Gfc(yi, ys, . . . , y^, zi, Z2, . . . , z^) : F^^ ^ F", be defined by Gk = (G^ , G^, . . . , G^). We refer 
to the polynomial mapping Gk as the fcth-order SV-generator, or SV-generator for short. We have 
the following "Generator Lemma": 

Lemma 1. Let f € V[X] be a nonzero RO-ABP-polynomial with \var{f)\ < 2"^, for some m > 0. 
Then f{Gm+i) ^ 0. 

To make further progress, we consider sums of k RO-ABPs. We give an explicit hitting-set of 
size n^(''+^°s^) for S^-RO-ABPs. Namely we have the following theorem: 

Theorem 1. Let {/, E F[X]}ig[fc] be a set of k RO-ABPs. Let f = ^^^^ fi- Provided |F| > kn-^, 
we have that / = Va € W^^ + A, /(a) = 0, where WJ^ = {y e {0, 1}" | vut{y) < k} and 

•^k = GmiV^"^) for the mth-order SV-generator with m = [logra] -|- 1, and V c¥ is a arbitrary set 
of size kn'^ -|- 1 . 

In the above for F, C F", V + W denotes the set {v + w : v G V,w G W}. By Theorem [H 
we obtain the following black-box PIT for S^-RO-ABPs: 

Theorem 2. Let f = 'Ylielk] fi ^ -^^"^ '^f ^ RO-ABP-polynomials in n variables. Let ¥ be a field 
with |F[ > kn^. Given black-box access to f , it can be decided deterministically in time n^(^+^°sn) 
whether / = 0. 

This strengthens a main result of [2] (Theorem 3, for the non-preprocessecH case) , which provides 
a deterministic 7^0{fc+iogn) ^^jj^g pj^j^ algorithm for S^-RO-formulas. Namely, we prove a strict 
separation between S^-RO-formula and Sfc-RO-ABP, for k < \n/2\. We show that 

Theorem 3. Uie[2n],i ^s oddUje[2n],j ts even^i^j can not be written as a sum of [n/2j RO-formulas. 

The polynomial of Theorem[3]can be computed by a single RO-ABP of size 0{n^) (see SectionE]). 
In the non-black-box setting we will prove the following result: 

generalization of our theorems to preprocessed Efe-RO-ABPs will not be pursued here. 
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Theorem 4. Let {^j}jG[fc] ^ ^ RO-ABPs in n variables. Let ¥ he a field with |F| > kii?. 

Given {^i}iG[fc] on the input, it can be decided deterministically in time OihP'n'^ s) + n'^'-'^^ whether 
^^gj^j fi = 0, where fi is the RO-ABP-polynomial computed by Ai, for f € [A;]. 

Since the construction in |19j can be computed efficiently, this strengthens Theorem 2 in [2], 
for the case of non-preprocessed Efc-RO-formulas. 

Finahy, if black-box access is granted to the individual /j's, which we call the semi- black- box 
setting, we obtain the following result: 

Theorem 5. Let {fi}i(^[k] be a set of k RO-ABP-polynomials in n variables. Let ¥ be a field with 
|F| > kn^ . Given black-box access to each individual fi, it can decided deterministically in time 
^2^0(logn) ^ ^O(fc) y;/jei/ier ^.g^^j fi = 0. 

1.2 Techniques for Sfc-RO-ABP PIT 

The results for S^-RO-ABP PIT are obtained through the hardness of representation approach of 
[TJI^. There the PIT algorithm is derived from a statement that xiX2 ■ ■ - Xn cannot be expressed as 
a sum oi k < n/3 RO-formula computable polynomials {fi}i(z[k], if the polynomials fi satisfy some 
special property. We do not need to define this special property for the discussion here, except that 
we should name it: 0-justification. 

Unfortunately, the property of 0-justification, does not work for the Sfc-RO-ABP model. With 
some thought it can be seen that the monomial xiX2 . . . Xn is expressible as the sum of three 
0-justified RO-ABP-polynomials. Our main technical contribution is the development of a new 
"special property" , called alignment, for which a hardness of representation theorem can still be 
proved, but which also can be satisfied simultaneously for a collection of RO-ABP-polynomials by 
means of an efficiently computable coordinate shift. 

With regards to the latter, consider / = /i+/2+- • ■+fk, where each fi is a RO-ABP-polynomial. 
Observe that Vw G F", / = <^=^ f{xi + vi,X2 + V2, ■ ■ ■ , Xn + Vn) = 0. With some technical 
work, we will establish a sufficient condition for alignment. With it we show that we can compute 
a coordinate shift v such that all fi{x -\- v) are aligned. Such a shift v is called a simultaneous 
alignment. In the case of having only black-box access to /, we will show we have a "small" set of 
candidates containing at least one simultaneous alignment. The PIT algorithms will follow from 
this. 

The rest of this paper is organized as follows. Section [2] contains preliminaries. In Section [3] 
we compare S^-RO-formulas and S^-RO-ABPs. In Section S] we prove Generator Lemma [TJ In 
Section [5] we develop the tools regarding alignment. Then in Section [6] we show how to compute a 
simultaneous alignment. Section [7] contains the hardness of representation theorem for RO-ABPs. 
From these developments, we put the PIT algorithms together in Section [8l 

2 Preliminaries 

Let X = {xi,X2, . . . , Xn} be a set of variables and let F be a field. Let = {y £ {0, 1}" | wt{y) < 
k}, where wt{y) counts the number of ones in y. 

Definition 1. (RO-ABPs) An algebraic branching program (ABP) is a 4-tuple A = (G,w,s,t), 
where G = {V, E) is an edge-labeled directed acyclic graph for which the vertex set V can be parti- 



4 



tioned into levels Lq, Li, ... , L^, where Lq = s and = t. Vertices s and t are called the source 
and sink of B, respectively. Edges may only go between consecutive levels Li and Lj+i. 

The label function w : E ^ X U¥ assigns variables or field constants to the edges of G. For a 
path p in G, we extend the weight function by w{p) = neep^(^)- d-enote the collection of 

all directed paths p from i to j in G. The program A computes the polynomial A := X^^gp^ ^ w{p). 
The size of A is defined to be \V\. 

An ABP is said to be read-once if < 1, for each Xi G X. That is, every variable is 

read at most once by the program. A polynomial / € ¥[X] is called a RO-ABP-polynomial, if there 
exists a RO-ABP which computes /. We use the following notation: for Xi present on arc (f , w) in 
a RO-ABP A: begin{xi) = v and end{xi) = w. We let source{A) and sink(A) stand for the source 
and sink of A. For any nodes v,w in A, we denote the subprogram with source v and sink w by 
Ajj^yij. A layer of a RO-ABP A is any subgraph induced by two consecutive levels Lj and Lj+i in A. 
We will assume RO-ABPs are in the form given by the following straightforwardly proven lemma: 

Lemma 2. /// € ¥[X] is a RO-ABP-polynomial, then f can be computed by a RO-ABP A, where 
every layer contains at most one variable-labeled edge. 

Let / be a polynomial in the ring F[X]. For a E F, f\xi=a denotes the polynomial 
f{xi,X2, . . . Xi-i,a,Xi+i, . . . ,Xn). Extending this to sets of variables, for a subset / C [n] and 
an assignment a € F*^, f\xj=aj is the the polynomial resulting from setting the variable Xi to in 
/ for every i ^ I. This is not to be confused with the following notation: for 5" C F"', we will write 
f\s = to denote that Ma G S, f{a) = 0. 

The following two notions are taken from [2]. We say that a polynomial / depends on a 
variable xi if there exists an a G F" and 6 G F, such that /(ai, 02, aj_i, aj, Oj+i, . . . , a„) 7^ 
/(ai, a2, aj_i, 6, flj+i, . . . , a„). The set of variables Xi that / depends on is denoted by Var{f). 
For a polynomial / G F[X], the partial derivative with respect to Xi, denoted by is defined as 
f\xi=i — f\xi=o- We will freely use the properties listed for this notion in [2]. For example, a mul- 
tilinear polynomial / depends on Xi if and only if ^ ^ 0. In addition, ^ does not depend on Xi. 

Partial derivatives commute, which we express by saying that ^ = Setting values to vari- 

ables commutes with taking partial derivatives in the following way: Vi / j, ^Jxj=a = Ox, - 

Lemma 3. Let f G ¥[X] be a RO-ABP-polynomial, then ^ is a RO-ABP-polynomial. 

Proof. Let p = \var{f)\. In case p = it is trivial. Assume p > 0. If Xj ^ var{f), then ^ = 0, 
in which case the property trivially holds. Now suppose Xi G var{f). Hence xi must appear 
somewhere in A. Say Xi is on the arc {vi,wi) from level Lj to Lj j^i, where Lj = {fi,f2, • • • ,Vmx} 
and Lj+i = {wi,W2, • • • , Wm2}-, for certain j, mi, m2. We can write 

/= X] X] fs,VaWiVa,Wb)fw^^t, (1) 
aG[mi] feG[m2] 
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where for any nodes p and q in A, fp^g is the polynomial computed by subprogram Ap^g. Then 
^ = f -f 

J\xi = l J\xi=0 

= X] X] fs,VaWiVa,Wb)\x,=lfwt,t - ^ ^ fs,VaWiVa,Wb)\x,=ofwa 
ag[m,i] be[m2] ae[mi] bG[r?i2] 

= Yl "Y fs,Va{w{Va,Wb)\x,=l-w{Va,Wb)\x^=o) fn,t,t 
ag[mi] b£[m2] 

~ fs,vifwi,t- 

Hence we obtain a valid RO-ABP computing ^ from A by setting the label of the wire (vi,wi) 
to 1, and removing all other wires between layers Lj and i^j+i- □ 

The proof of the above lemma provides the insight that a RO-ABP computing ^ can be 
obtained from a RO-ABP computing /, by setting Xi = 1 and removing all other edges in the layer 
containing x,. This fact will be used at several places in the paper. Finally, observe the following 
simple-but-useful factor-lemma: 

Lemma 4. // / € ¥[X] is a RO-ABP-polynomial such that / ^ and f = g ■ {Pxi — a), then g is 
a RO-ABP-polynomial. 

Proof. This follows from the fact that for every 7 with /3j — a ^ 0, g = ■ f\xi='y ^ 
2.1 Combinatorial Nullstellensatz and a Lemma by Gauss 

Lemma 5 (Lemma 2.1 in |25j). Let f € be a nonzero polynomial such that the degree of f 

in Xi is bounded by ri, and let Si ¥ be of size at least ri + 1, for all i € [n]. Then there exists 
(si, S2, • • • , s„) G 5i X ^2 X . . . X 5„ with /(si, S2, . . . , s„) / 0. 

Lemma 6. (Gauss) Let P G F[X, y] be a nonzero polynomial, and let g G ¥[X] be such that 
P\y=g{x) = 0- Then y — g{x) is an irreducible factor of P in the ring ¥[X\. 

3 Separation of RO-ABP and EL„/2j-RO-formulas 

For n > 2, let /„ be defined as 

fn{xi,X2,...,X2n-l,X2n)= JJ XiXj. 

jG[2n],i is odd jS[2n],j is even 

Proposition 1. /„ can be computed by an RO-ABP of size 0{n'^). 

Proof. The RO-ABP is shown in Figure [TJ Note that between the (n + l)th level and the (n + 2)th 
level there is an n by n complete bipartite graph. 

□ 

Proposition 2. A polynomial p{xi,X2, ■ ■ ■ , Xn) that contains three terms of form aXiXj + PxjXk + 
'jx^xi, where i,j,k,l G [n] are pairwise different, and a,l3,j G F are nonzero, can not be computed 
by a RO-formula, for n > 4. 
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Proof. For the purpose of contradiction, suppose there is a RO-formula F computing p. Setting all 
Xm = 0, for m G [n] \ {i,j,k,l}, would result in an RO-formula F' computing p'{xi,Xj,Xk,xi) = 
axiXj + f3xjXk + JXkXi + axi + bxj + cxk + dxi + e. However, p' can not be computed by an 
RO-formula. One argues this in a similar manner as for xiX2 + X2X3 + X3X4 (See example 3.12 in 

□ 

Consider the complete bipartite graph G„ = {Vn,En) for /„, called the graph associated with 
/„, shown in Figure [2j Every edge represents a term in /„. The term XiXj + XjX^ + x^xi can be 
viewed as a length-3 path in G„. 

Proposition 3. Let n > 2. In Gn, for an edge set S C En with \S\ > 2n — 1, S must contain a 
length-3 path. 

Proof. We just need to prove that for Gn, the maximum "length-3 path free" edge set is of size 
at most 2(n — 1). This is proved by induction on n. For n = 2, it is easy to see that it holds. 
Suppose for n < ^ the claim holds. Then for n = I, for any length-3 path free edge set S, consider 
the following two cases: 

1. If there exists an edge e = {u,v) G S, for which u or v has no other outgoing edges, let 
S' = S\{e}. S' is a length-3 path free set in Gi^i. By induction, \S'\ < 2{l — 2). Thus S has 
at most 1 + 2(/ - 2) < 2{l - 1) edges. 

2. Otherwise, partition the vertices adjacent to edges in S into two sets Vi and V2, where Vi 
contains all vertices of degree one, and V2 contains all vertices of degree larger than one. 
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Figure 2: The bipartite graph G„ for /, 



It is noted that since no length-3 paths exist, we have that |S| = |Vij. If IV2I > 2, then 
\Vi\ < 21 — 2 = 2(1 — 1), since there are at most 21 vertices adjacent to edges in S. In 
case IV2I = 1, then S" is a star, i.e. a single vertex u connected to a coUection of vertices 
vi,V2, ■ ■ ■ , Vk- Then k < I and \S\ = k < I < 2(1 — 1), for / > 2. 

□ 

Theorem 6. /„ can not be represented as a sum of [n/2\ RO-formulas. 

Proof. For the purpose of contradiction, suppose /„ can be represented as a sum of [n/2j RO- 
formula-polynomials qi,q2, ■ ■ ■ , 9[n/2j • Let Gn = (Vn, En) be the graph associated with /„. For any 
Qi, let Si C En be the set of edges representing the terms appearing in qi of the form XaXh, where 
a G [2n\ is even, and b G [2n\ is odd. Note that since / has n? many terms, some should have 
> 2n. Then by Claim [3l Si contains a length-3 path. Therefore axiXj + (5xjXk +'yxkXi appears 
in Qi, for distinct k and nonzero constants a, /?, 7 G F. Due to Claim [21 can not be computed 
by a RO-formula, which is a contradiction. □ 



4 Proof of Generator Lemma [T] 

Let p = \Var{f)\. The proof proceeds by induction on p. The bases p = and p = 1 trivially hold. 

Suppose p > 1. Hence m > 1. Consider arbitrary RO-ABP A computing /. Let s and t be the 
source and sink of A, respectively. Wlog. assume that only the p variables in Var{f) are present 
in A, and assume A satisfies the condition yielded by Lemma [2j Observe that for some variable Xi 
there are at most p/2 variables in layers before the layer containing Xj, and at most p/2 variables 
in layers after. (If p is odd it splits {{p — l)/2), {p — l)/2) if p is even it splits {p/2 — l,p/2)). 

Say Xi is on the arc (vijWi) from layer Lj to Lj^i, where Lj = {vi,V2, ■ ■ ■ ,Vmi} and Lj = 
{vi,V2, . . . , Vni2}, for certain j, mi,m2- We can write 

mi 

/ ~ y ^ fs,Vafva,tj (2) 

a=l 
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where for any nodes p and q in A, fp^q is the polynomial computed by subprogram of Ap^q. Consider 

J J V^rrn • • • ) i ■''*) ; • • • ) ^m)' 

Claim 1. Write f = Xi ■ §i-{Gl^, , . . . , ^, C^^, . . . , G^J + /(G^, , . . . , GJ^ ^, 0, G*^^, . . . , G^). 
-^^^^ dx^i^rm ) • • • ) G^ ^, G^^, . . . , GJ^) ^ 0. 

Proof. Since / depends on Xj and / is multilinear, ^ ^ 0. Let /" = We will show that 
f"{Gm) ^ 0. Observe that in the r.h.s. of ([2]) only fy^^t depends on Xj. This implies that 
/" = . /,_^^. Observe that \Var{fs,v^)\ and \Var{^^)\ are both at most p/2. Since /" ^ 0, 

both fs^vx and are not identically zero. Certainly fs^v^ can be computed by a RO-ABP. By 

LemmaO we know also can be computed by a RO-ABP. As p/2 < p, the induction hypothesis 

applies. Since p/2 < 2™"!, it yields that fs,vAGm) ^ and ^^(G^) ^ 0. Therefore /"(G„) ^ 0. 
This proves the claim. □ 
Recall the set A = {ai,... ,a„} used for the construction of the SV-generator. By Observa- 
tion 5.2 in [2J, f{Gm+i)\y^+i=a, = f\x,=Gi^+z^+^- ^"^+1 '^^^ appear in Gin for any j, we 
get by ClaimEthat /(G^+i)|y„^,=„/^ 0™ Hence /(G„,+i) ^0. □ 



5 X-Aligned RO-ABP-polynomials 

The following lemma leads up to our central definition: 

Lemma 7. . For all i G [k], Let f e ¥[X] be a RO-ABP-polynomial with \Var{f)\ > 3. Then for 
any Xi G Var{f), there exist distinct Xj,Xk € X\{xi} such that = g ■ {(3xi — a), where g is 

a RO-ABP-polynomial that does not depend on Xi, and a, (3 G F. 

Proof. Let j4 be a RO-ABP computing /. Wlog. assume all variables in X appear in A. By 
Lemma [2] assume wlog. that A has at most one variable per layer. Let be the 

variables in X as they appear layer- by-layer, when going from the source to the sink of A. Consider 
an arbitrary Xj G Var{f). First, we handle the case that i = rm, for some 1 < m < n. 

Let j = r^a^i and k = r^+i- So Xj and Xk are the variables right before and right after Xj 
in A, respectively. Assume that Xj and Xk label the edges (n, v) and (m, n) respectively. Then 

9^0^ = fs,ufv,mfn,t, where fs,ufv,m, and fn,t are computed by the subprograms As,„,^t,,m, and 
An^t, respectively. Observe that f^^m is of form /3xj — a, for a,f3 £ ¥. Take g = fs,ufv,m, which 
is easily seen to be RO-ABP-computable by putting Ag^u and A^^m in series, or by appealing to 
Lemmas [3] and HI 

The special case where i = ri {i = rn), i.e. x, is the first (last) variable in A, is handled similarly 
as above, by choosing x^ G X\{xi,Xj} arbitrarily and appealing to Lemma[3j □ 

In the above lemma we have no guarantee the a is nonzero, in case (3^0. We would like to 
consider polynomials which are in general position in this regard. We make the following definition: 

Definition 2. Let S C X. Every RO-ABP-polynomial f G ¥[X] with \Var{f)\ < 2 is X-pre- 
aligned on S. A RO-ABP-polynomial f G ¥[X] with \Var{f)\ > 2 is X-pre-aligned on S, if the 
following condition is satisfied: 
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1. for every Xi € S, there exist distinct Xj,Xk € X\{xi} such that J^^ = g-(j3xi—a), where g is 
a RO-ABP-polynomial that does not depend on Xi, and a,(3 ^ F satisfy that a = =^ /? = 0. 

If f is X-pre-aligned on Var{f), we simply say that f is X -pre- aligned. 

For the X-pre-alignment property to hold recursively w.r.t. setting variables to zero, is a 
particularly desirable property of a RO-ABP-polynomial to have, as we will see. We make the 
following inductive definition: 

Definition 3. Every RO-ABP-polynomial f G ¥[X] with \Var{f)\ < 2 is X-aligned. A RO-ABP- 
polynomial f € ¥[X] with \Var{f)\ > 2 is X-aligned, if the following conditions are satisfied: 

1. f is X-pre-aligned, and 

2. for every Xi £ Var{f), /|^.=o ^-^ X\{xi} -aligned. 

Next we prove some of the needed properties of our notion, starting with the following easily 
verified statement: 

Proposition 4. // / € ¥[X] is X-pre-aligned, then G F, ji ■ f is X-pre-aligned. The same 
statement holds with aligned instead of pre- aligned. 

The notion of X-pre-alignment is well-behaved w.r.t. taking partial derivatives. This will be 
crucial for obtaining the Hardness of Representation Theorem El We have the following lemma: 

Lemma 8. For any RO-ABP-polynomial f € ¥[X] and any x^ £ X , the following hold: 

1. If f is X-pre-aligned, then is {X\{xr}) -pre- aligned. 

2. If f is X-aligned, then is {X\{xr}) -aligned. 

Proof. We first show that Item [T] holds. Let /' = and X' = X\{xr}. By Lemma El we know 
that /' is a RO-ABP-polynomial. Assume that \Var{f')\ > 3, since otherwise the statement holds 
trivially. Consider arbitrary Xi € Var(f'). Then Xi G Var{f), so there exist distinct Xj and Xk in 
X\{xi}, such that J,^ = g ■ — a), where g is s, RO-ABP-polynomial that does not depend 
on Xi, and a = =^ /3 = 0. Consider the following two cases: 
Case I: r ^ {j, k}. 

Hence Xj,Xk G X'\{xi}. We have that = = ^ • {f3xi - a). By Lemma El 

is a RO-ABP-polynomial, and it clearly does not depend on Xj, so we conclude that /' is 
X'-pre-aligned on {xj}. 
Case II: r G {j, k}. 

Wlog. assume r = j. Then Xk G X'\{xi}. Since \Var{f')\ > 3, there must be at least one 
more variable xi in Var{f') distinct from each of x^ and Xj. Then xi G X'\{xi}. We have that 
§^ = g - {Pxi - a). Hence q^Jq^^ = ^ ■ {Pxi - a). We again conclude /' is X'-pre-aligned on {xi}. 

Since in the above, Xj was taken arbitrarily from Var(f'), we conclude /' is X'-pre-aligned. 

Item[2]is proved by induction on \X\. The base case is when \X\ < 3. Then \Var{f')\ < 2, and 
hence /' is X'-aligned. Now suppose \X\ > 3. Assume \Var{f')\ > 2, since otherwise it is trivial. 
By Itemlll we know /' is X'-pre-aligned. Consider an arbitrary Xi G Var{f'). Then Xi G Var{f). 
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induction hypothesis to conclude that ° is {X\{xi})\{xr} = (X'\{xj})-aHgned. □ 



We have that /L=o = 3^ = — • Since f\xi=o is (X\{a;j})-ahgned, we can apply the 

' ' \ / xi=0 



5.1 A Workable Sufficient Condition 

Next we establish a sufficient condition, so for a given RO-ABP-polynomial / we can make f{xi + 
vi,X2 + V2, . . . ,Xn + Vn) X-aligned, by means of computing some shift v £ For this, let us call a 
polynomial / € ¥[X] decent, if for all Xa,Xh € Var{f) with ^ 0, it holds that the monomial 

XaXb appears in / with a nonzero constant coefficient. 

Lemma 9. A RO-ABP-polynomial f € ¥[X] is X -aligned, if \Var{f)\ < 2, or else for any I C 
Var{f) with \I\ < \Var{f)\ — 3, f\x,=o is decent. 



Proof. We use induction on |yar(/)|. For the base case |yar(/)| < 2 it is trivial. Now assume 

dxadxt 



\Var{f)\ > 2. Take / = 0. Then we get that for any Xa,Xb G Var{f), if ^ ^ / ^ then the 



monomial XaXb appears in / with a nonzero constant coefficient. 

Let us first establish that / is X-pre-aligned. Consider an arbitrary Xi € Var{f). By Lemma[7l 
there exist distinct Xj,Xk € X\{xi} such that 

d^f 

- — — = g ■ {I3xi - a), (3) 

OXjOXk 

where 5 is a RO-ABP-polynomial that does not depend on Xj, and a,(5 (z F. 

If /3 = 0, then / is X-pre-aligned on {xj}, so suppose /? 7^ 0. If ([3]) is identically zero, then we 
know g = 0, so = g ■ {(3xi — a'), for any arbitrary a' 7^ 0. If ([3]) is not identically zero, then 

we know XjXk is in /, which implies that a ^ 0. We conclude that / is X-pre- aligned on {xj}. 

In the above, we find that / is X-pre-aligned on {xi} in any of the considered cases. Since Xi 
was arbitrarily taken from Var{f), we conclude that / is X-pre-aligned. 

Next, we show Condition [2] of Definition [3] holds. Consider /' := f\xi=o, for an arbitrary Xi G 
Var(f). We want to establish that the sufficient condition of Lemma [9] holds for /' G F[X\{xj}], 
since then we can by apply the induction hypothesis and conclude that /' is (X\{xj})-aligned. 

If \Var{f')\ < 2 the sufficient condition of the Lemma [9] clearly holds for /'. Otherwise, consider 
/' C Var{f') of size at most \Var{f')\-3. Let I = /'U{xi}. Then |/| < \Var{f)\-3. Now consider 

9^ f 02 f 

Xa,Xb G yar(/^^,=o) = ^ar(/a;^=o)- Suppose ■ 

dxadxi, ^ ^' Si'^'^^ the latter equals Qxadxi, ^ 
know that XaXb appears with a nonzero constant coefficient in f\xj=o- This implies XaXb appears 
with a nonzero constant coefficient in /|^^,=o- Hence /^^, ^ is decent. 

We conclude the sufficient condition of the Lemma [9] holds for /' G F[X\{xj}]. Hence by the 
induction hypothesis we conclude that /' is (X\{xj})-aligned. □ 

Lemma 10. Any decent RO-ABP-polynomial f G ¥[X] is X-aligned. 

Proof. We show that the condition of Lemma[9]is satisfied. If |yar(/)| < 2 this is clear. Otherwise, 
consider arbitrary I C Var{f) with |/| < \Var{f)\ — 3. Let Xa,Xb G Var{f\xj=o)j be such that 

VJXH ^ 0- We have that Xa,Xb G Var{f), and it must be that ^ 0, since = 

. Hence XaXb is in /. This implies that XaXf, is in f\xj=o- D 



dxadxt, 
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5.2 Neeirly Unique Nonalignment 

In addition to the above, we crucially need the following "Nearly Unique Nonalignment Lemma" . 

Lemma 11. Let f G ¥[X] be an X-pre-aligned RO-ABP-polynomial for which ^ 0, for any 

distinct Xp, Xq G X. Then there are at most two 7 G F such that f\x„='y ™t {X\{xn}) -pre- aligned. 

Before giving the proof, we need a lemma. 

Lemma 12. Let f G ¥[X] be a RO-ABP-polynomial with \Var{f)\ > 3 that is X-pre-aligned on 
S, for some S C Var{f). Assume that for any distinct Xp,Xq G X, ^ 0. In any RO-ABP A 

computing f , for any Xi G S, 

1. if there exists a non-constant layer with variable Xa right before the Xi-layer, and there exists 
a non-constant layer with variable Xb right after the Xi-layer, then 

d'^f 

- g ■ {(3xi - a), 



dxadxb 



where g is a RO-ABP-polynomial that does not depend on xi, and a,(3 G F satisfy that 
a = ^ P = 0. Furthermore, —a equals the sum of weights of all paths from end{xa) to 
begin{xb) that do not go over Xi. 

Proof. Consider Xi G S. Since / is X-pre-aligned on S, we know there exist distinct Xj,Xk G X\{xi} 
with Q^.Q^^ = h ■ {P'xi — a'), where h is a RO-ABP-polynomial that does not depend on Xi, and 

a',(3' e F satisfy that a' = ^ /?' = 0. Since ^ 0, it must be that a' 0. 

Case I: In A, the Xj-layer lies in between the Xj-layer and x/. layer. 

Wlog assume the Xi layer lies before the x^-layer and after the x^-layer (according to the order 
of the DAG underlying A). Write gj-^ = P1P2 ■ iqiq2Xi + 53), where 

• pi is the sum of weights over all paths in A from source(A) to begin{xj), and p2 is the sum 
of weights over all paths in A from end{xk) to sink{A). 

• 53 is the sum of weights over all paths from end{xj) to begin{xk) that bypass the Xj-edge, qi 
is the sum of weights over all paths from end{xj) to begin{xi), and q2 is the sum of weights 
over all paths from end{xi) to begin{xk). 

Now we have that pip2 • {qiq2Xi + qs) = h - {P'xi — a'). Since both piP2 and h do not depend on 
Xi, it must be that {(3'xi — a') \ {qiq2Xi -\- qs). Note that (3' cannot equal 0, since then one of qi, q2 
would be zero. The latter implies that g^J^, = or g^J^^ = 0, which is a contradiction. Since 
P' 0, we can conclude that 53 = fJ-qiq2 for some fi e¥, ^ 0. Now we need the following claim: 

Claim 2. Given an RO-ABP A computing f{xi, . . . , Xn), if for any distinct Xp, Xq G X, g^^g^^ ^ 0, 
then nie[n] -^i appears in f. Furthermore, for two variables Xi and Xj, if Xi is before xj in A, if 
we let S be the set of variables in between Xi and xj, then YlxmeS ^ term in the polynomial 

A{end{xi), begin{xj)). 

Proof. Suppose the variable layers in A are arranged according to the permutation (/):[«]—>■ [ra], 
that is, labels the iih variable layer. Then we that 
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1. A{s,begin{x^(^i^)) ^ (Since otherwise 

2. Similarly A(end{x^(^j^-^),t) ^ 0, and 



'a:^(i)Cx0(2) 



0) 




0). 



and hence rTieW ^* appears in /. A similar argument yields the statement for A{end{xi), begin{xj)). 



□ 



As in the proof of Lemma [71 write = g ■ {(3xi — a), where g' is a RO-ABP-polynomial that 

does not depend on Xi, and —a equals the sum of weights over all paths from end{xa) to begin{xb) 
not going over Xj. We have three cases: 

1. Neither xj nor x^ is the most adjacent variable to Xi in A. By above claim, Xa appears in a 
monomial of qi, and Xf, appears in a monomial q2- Hence, there is a monomial in qiq2 with 
XaXb- As qs = nqiq2, for fJ. 0, the same can be said for q^. But this implies q 7^ 0, as the 
coefficient of XaXj, is —a ■ A{end{xj),begin{xa))A{end{xb),begin{xk))- 

2. Xj is not the most adjacent variable to Xi in A, but Xk = Xb- Then similarly qiq2 has 
a monomial with Xa in it, and therefore the same holds for 53. Therefore a ^ 0, as the 
coefficient of Xa in q^ is —a ■ A{end{xj), begin{xa))- 

3. Xj = Xa, but Xk is not the most adjacent variable to Xi in A. This is argued similarly as the 
second item. 

This concludes the argument for this case. 

Case II: In A, the Xj-layer lies before the Xj-layer and x^-layer. 

Wlog. assume that the Xj layer lies before the Xk layer. Similarly as in Case I, we write 
Q^.Q^^ = P1P2 ■ {qi<l2Xi + but where now we have that 

• Pl = vlend(a;j),6egi?i(a;fc); and P2 = ■^end(xi,),sink{A)i 

* Ql -'^source{A),begin(xi): 

* Q2 -^end{xi),begin{xj) : 

• 93 = A[Xi = 0]source{A),begin{xj)- 

Then pip2 • {qiq2Xi + qs) = h ■ {(3'xi — a'). Since both piP2 and h do not depend on xi, it must 
be that {fi'xi — a') \ {qiq2Xi + q^). Similarly as before, we get gs = iJ,qiq2 for some /i G F, ^ 7^ 0. 

The rest of the proof is similar to Case I. One argues that 1) when Xj 7^ Xb, qiq2 contains a 
monomial with XaXb- To make XaXf, appear in a monomial q^ we need a 7^ 0, and 2) when Xj = xi,, 
Q1Q2 contains a monomial with Xa, and to make Xa appear in a monomial of (73, we need a 7^ 0. 
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Case III: In A, the Xj-layer lies after the Xj-layer and Xfc-layer. 

This case is symmetrical to Case II. □ 

We also need the following proposition: 

Proposition 5. Let f G ¥[X] be a RO-ABP-polynomial with \Var{f)\ > 3, and let S C Var{f). 
Then f is X -pre- aligned on S if and only if f := + 1)/ is X\J {xn+i}-pre-aligned on S. 

Proof. Let X' = XU {xn+i}. It is easy to see that assuming / is X-pre-aligned on S, we have that 
/ is X'-pre-aligned on S. 

Conversely, assume /' is X'-pre-aligned on S. Let € S. Then there exist Xj,Xk € X'\{xi}, 
such that Q^.Q^^ = g{f3xi + a), where 5 is a RO-ABP-polynomial that does not depend on Xj, and 

a = implies /3 = 0. If Xn+i {xj,Xk}, then q^-§^ = gj-^(x„+i + 1). Setting Xn+i = 0, we have 

that ■ = {g\^^_^^^Q){(3xi + a). So we get the required X-pre-alignment of / on {xj. Otherwise, 

say wlog. Xj = Xn+i- We have that = ^^q^^ = g{(5xi + q). One easily obtains the required 
X-pre-alignment of / on {xj}, by taking one more dxi, for some variable xi € X\{xj, x^}, and then 
using Lemma El □ 

We are now ready to give the proof of Lemma [TTl 
5.3 Proof 

We prove the lemma by induction on \X\. For the base case we take \X\ < 3, in which case the 
statement clearly holds. Now suppose \X\ > 3. Let /' = f^^^^^, for some 7. Let X' = X\{xn}- 
Suppose /' is not X'-pre-aligned. Hence \Var{f')\ > 3. We want to show this can happen for at 
most one 7. 

Consider an arbitrary RO-ABP A computing /. Let /e = /(x„+i + l)(x„+2 + l)(3;n+3 + l)(a^n+4+ 
1). Let Xe := X U {x^+i, x„+2; a;„+3, Xn+4}. By Proposition [SI fe is Xg-pre-aligned on Var{f). 
Let /e := {fe)\x^=^ and X'^ := X' U {x„+i, x„+2, a^n+a, a;n+4}- Note that = f'(xn^\ + l)(x„+2 + 
l)(xn+3 + l)(2;n+4 + !)• So also by Proposition [SI is not Xg-pre-aligned on Var{f') if and only if 
/' is not X'-pre-aligned on Var{f'). We will show the former happens for at most one 7. So let us 
assume that /g is not Xg-pre-aligned on Var{f'). We can easily obtain a RO-ABP A^ from A, which 
computes fe- In this, we make sure x„+i and x„+2 are the first and second variable in A^, and Xn+3 
and Xn+A are the fore-last and last variable in Ae- For each Xj € Var{f'), let Xj. be the variable 
right after Xj in A'^, and let Xfc. be the variable before x, in Ag. Note that we have made sure these 
always exist in A^.. Since fe is Xg-pre-aligned on Var{f), by Lemma [T2l = g ■ {PiXi — Oj), 

where 5 is a RO-ABP-polynomial that does not depend on Xj, and = ^ /?j = 0. Furthermore, 
we have that is the sum of weights of all paths from end{xki) to begin{xn), which do not go over 
Xi in Ae- Consider the following two cases: 

Case I: n {ji, ki}, for any Xj £ Var{f'). 

Then for any i, g° = {gi)\^^^^ ■ {PiXi — Oj), which contradicts the assumption that /g is 

not Xg-pre-aligned on Var{f')- 

Case II: n € {ji, ki}, for some Xj € Var{f'). 

By symmetry we can assume wlog. that ji = n (the case ki = n is handled similarly). Since 
^ 0, and aj = implies /3j = 0, We have that Ui 7^ 0. 
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We know that in there stiU exists a variables layer, say with variables xi, right after the 
Xj, -layer. Let bi = begin{xi), Ci = end{xi),bn = begin{xn), and = end{xn)- Let s = end{xkj 
and t = begin{xi). Then write: 



dxidx 



where in the above each constant Cy^w is the sum of weights over all paths from v to w going over 
constant labeled edges only. Note that Cg^b^ = Oj 7^ 0. Furthermore, pi is the sum of weights of all 
paths from source{Ae) to begin{xkj, and p2 is the sum of weights over all paths from end{xi) to 
sink{Af,). Then 

- PlP2{{Cs,b,Ce„b„Ce„,a + Cs,biCe„t)Xi + Cs,6„Ce„,t7 + C^,t), 



dxidx 



lOXk, 

We have that /g can only not be Xg-pre-aligned on {xj} if Cs^b„(^e„,tl + Cs^t = 0. This can happen 
for more than one 7 only if Cs^b„Cen,t = 0. Since Cs^bn 7^ 0, this happens only if Ce„,t = 0, but the 
latter implies that q^^q^ = 0, which in turn implies that q^^q^ = 0, which is a contradiction. 

Finally, putting together from what we observed from the above two cases, note that. Case II 
can apply at most twice for a variable Xi G Var{f'). Namely, possibly once for the variable right 
before x„, and possibly once for the variable after x„. We conclude the lemma holds. □ 



Corollary 1. Suppose |F| > 3. Let h,g ^[X] be RO-ABP-polynomials such that h = g-{l3xn — Oi), 
for (3 € F\{0}. If h is X -pre- aligned, then g is {X\{xn})-pre-aligned. 

Proof. If we set x„ to any value ^ ^ a/l3, we get that h^^^^^ is a nonzero constant multiple of g. 
By Lemma [m there are at most two 7 such that /i|x„=7 is not (X\{x„})-pre-aligned. Now use 
Proposition m to conclude that g is (X\{x„})-pre-aligned. □ 



6 Simultaneous Alignment of RO-ABP-polynomials 

Definition 4. A simultaneous X- alignment for a set of RO-ABP-polynomials {fi S F[X]}jg[fc] is 
a vector f G F" such that fi{xi -\- vi, X2 + V2, ■ ■ ■ , Xn -\- Vn) is X -aligned for every i €z [k]. 

We present an algorithm for finding a simultaneous X-alignment for a set of RO-ABP- 
polynomials. We assume that we have a polynomial identity testing algorithm PITpq-abp for testing 
a single RO-ABP. We prove a corollary of Lemma [TOl first. 

Corollary 2. Let {fi}i£[k] be a set of RO-ABP-polynomials in¥[X]. Thenv S F" is a simultaneous 
X -alignment for {fi}i(z[k], if it is a simultaneous nonzero for { q^Jq,^^ j gCfe ^ 0}*e[fc],a,6g[n] • 

Proof. Consider {f[ = fi{xi + vi,X2 + ^2, ■ ■ ■ + Vn)}ie[fc]- Due to Lemma [TOl we only need to 
show that for every i, for every Xa-,Xb € Var{fi)^ if ^ then the monomial XaXb appears in 

with a nonzero constant coefficient. Observe that the monomial XaXb appears in f'^ with a nonzero 
constant coefficient ^ aSfe(O) ^ 0- The latter holds, as a3^(0) = agfe(^) / 0. □ 
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Now the argument is similar as for Lemma 4.3 in [2j, but with first order partial derivatives 
replaced by second order ones. This yields the following theorem: 

Theorem 7. Let ¥ be a field with \¥\ > kn?. There exists an algorithm for finding a simultaneous 
X -alignment for a set of RO-ABP polynomials {fi G F[X]}jg[fc]. The algorithm makes oracle calls 
to the procedure PITpq-abp- The fiS are only accessed through this subroutine. The running-time 
of the algorithm is 0{k'^n^ ■ t), where t is an upper bound on the time needed for any subroutine 
call to VIT ifo-ABP- 

Proof. We assume that we have a polynomial identity testing algorithm PIT^o-abp for testing a 
single RO-ABP, such that PITrq-abp outputs True if / = and False otherwise. We have the 
following algorithm: 

Algorithm 1 Alignment Finding. 

Input: A set of RO-ABP-polynomials {fi G F[X]},jg[fe]. 
Output: A simultaneous alignment v for {fi}i£[k]- 
Oracle: PIT algorithm PITrq-abp- 



1 


L = 




2 


for all fi and {xa,Xb), 


a,b [n], a b do 


3 


If ^^^no-A^Adxadxb) 


= False, add it to L 


4 


end for 




5 


for all j G [n] do 




6 


Find c such that for 


every g e L, PITro-abp(5 


7 


Vj ^ c 




8 


For every g L, g <- 


" 9 \xj=c 


9 


end for 




10 


return v 





We first make two remarks, which pertain to applying Algorithm 1 in the setting where we only 
have black-box access to each /j. Consider the set L the algorithm constructs with the execution 
of the first for-loop. Since we only have black-box access to fi, the given pseudocode is intended 
to mean L is constructed symbolically. Having black-box access to fi is enough to have black-box 
access to any element of L. Namely, by Lemma [31 / := is a RO-ABP. Note that black-box 

access to fi is sufficient for being able to compute /'(a) for any a G F". This is all the black-box 
RO-ABP algorithm needs to decide whether /' = 0. 

Similarly, on line [8] the substitution is not actually carried out, but done symbolically. So it is 
just remembered that Xj is set to c. For example, suppose that up to some point in the execution the 
algorithm it has set Xi = Ci, for i G [m]. Then on linelU ^or evaluating PITro-abp(5 \xj=c), the black- 
box algorithm is granted access to a RO-ABP in n — m variables g(^c\, C2, . . . , c^a, XYn-\- \ ? • • • ; -^n) • 
The queries it makes can be answered with only black-box access to g. 

Now, by Corollary [2] it suffices to find a common nonzero of the set L. First however, we need 
to explain how to find c such that g \x =c^ 0. Let C F with \V\ = kn^ + 1 be given. We claim V 
always includes a good value. This is because we have at most kn^ multilinear polynomials in L, 
and for a specific one there is at most one bad value, due to Lemma [6l The algorithm can simply 
try all elements in V to get the required c. The correctness of the algorithm is now evident, from 
the observation that it simply maintains the invariant that all 5 G L are not identically zero. 
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The running time of the algorithm is as follows: for line 2 we need 0{kii?) calls to PIT^o-abp- 
For line 7 we need 0{n-{kn?' + l)-{k'n?)) = 0{k'^n^) calls to PITrq-abp- Thus the total running time 
of the algorithm is 0{k'^rv' ■ t), where t is an upper bound on the time needed for any subroutine 
call to PITfio-ABP- 

By Lemma [1] and using Lemma \5\ PIT^o-abp can be implemented in the black-box setting to 
run in time n'-^^'"^"), where n is the number of variables of the input RO-ABP-polynomial. In the 
non-black-box setting, as is show in Appendix [Cl PITrq-abp can be implemented to run in time 
O(n^s), when given an RO-ABP over n variables of size s. This yields the following two corollaries: 

Corollary 3. Provided |F| > kn?, there exists an non-black-box algorithm for finding a simultaneous 
X -alignment for a set {fi S F[X]}jg[^,], where fi is computed by a RO-ABP Ai, for i S [k]. The 
algorithm receives on the input, and it runs in time 0{k'^n'^s), where s is an upper bound 

on the size of any Ai. 

Corollary 4. Provided \¥\ > kn^, there exists a black-box algorithm for finding a simultaneous 
X -alignment for a set of RO-ABP-polynomials {fi G ^^[Xjjjgjfc] . The algorithm queries individual 
fiS, and runs in time A;^n'^('°S") . 

6.1 Simultaneous Alignment Hitting Set 

Here we present a black-box algorithm to find a candidate set Ak of size {kn)^^^°^'^\ which is 
guaranteed to contain a simultaneous X-alignment for any set of k RO-ABP-polynomials {fi G 

Lemma 13. Let¥ be afield with |F| > kn'^, and letV Q¥ with \V\ = kn^-\-l be given. Let {fi}i£[k] 
be a set of RO-ABP-polynomials in ¥[X]. Let Gm ■ F^"* F" be the mth-order SV-generator with 
m = [logn] + 1. Then Ak '■= Gm{V'^™') contains a simultaneous X -alignment for {fi}ie[k]- 

Proof let L = {g^^ \ £§^^ ^ 0},^ik],a,b€ln]- Let P{xi,...,xn) = UgeL9{xi,...,Xn). By 
Lemma [3l each 51 G L is a RO-ABP-polynomial. Hence by Lemma [H for m = [logn] + 1, 
the SV-generator (G^, G^, . . . , GJ^), satisfies that ^(G^, G^, . . . , G^) ^ 0, for all g ^ L. So 

Note that there are 2m variables in P{G]^, . . . , GJ^), and the degree of every variable is bounded 
by kn^-n'^ = kn^. Thus by LemmaEl 3a G V^"^ ,P{Gi,{a), . . . ,G;^(a)) / 0. Hence Ak = G„(y2™) 
is ensured to contain a nonzero of P. Any nonzero of P is a simultaneous nonzero of all g € L. By 
Corollary [21 Ak contains a simultaneous X-alignment for □ 

7 A Hardness of Representation Theorem for RO-ABPs 

The following theorem is an adaption of Theorem 6.1 in [2] to the notion of X-pre- alignment. One 
notable difference in the proof is that for the main case separation, we distinguish between whether 
there are 3rd-order partial derivatives vanishing or not (rather than 2nd-order partial as in [2]). 

Theorem 8. Assume |F| > 3. Let Pn = HiGM^*- V {fi ^ IF'i^llielfc] o, set of k X-pre-aligned 
RO-ABP-polynomials for which Pn = Z^ig[fc] fi, then n < 7k. 
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Proof. The proof proceeds by induction on k. For the base case k = 1, since /i = P„, and /i is 
X-pre- aligned, it must be that n < 2. Namely, if n > 2, then for Xi G Var{Pn), whatever distinct 
Xj,Xk G X\{xi} we select, q^.qI^ = xi ■ Ilxrex\{xi,Xj,Xk}- ^^^^ cannot be of the form g ■ {l3xi + a) 
with g being an RO-ABP not depending on Xi, and a = =^ /3 = 0, as Definition [5] requires. 
Namely, since g does not depend on Xi, it must be that (3 ^ 0. Hence a 7^ 0, and thus g ■ {f3xi + a) 
is not homogeneous. Since Xi ■ Y\xr€X\{xi Xj x^} homogeneous, this is a contradiction. 

Now assume k > 1. Suppose we can write P„ = Yli<^[k] fi- -^^^ purpose of contradiction, assume 
that n > 7k. Hence n > 14. 

Case I: 3 distinct p,q,r € [n] and s € [A;], such that q q {"q — = 0. 

Wlog. assume that p = „ - 2, , = „ - 1.. = „ and . = 1. Thl E..,-, ,.,._SJL,.., = 

By Lemma [HI all of the terms gx^^^^dx^-idxn i-^Xi^ 

n— 2 ) Xii—l, Xfi })-pre-ahgned. By induc- 
tion, it must be that n — 3 < 5(/c — 1). Hence n < 5k — 2, which is a contradiction. 
Case II: ^ distinct p,q,r ^ [n] and s € [k], such that QxpOxqdxr ^ ^' 

We know Vi, \Var{fi)\ > 3. Since fi is X-pre-aligned, there exist distinct Xj^^x^^ € X\{xi} 
such that g^, , / , = gi ■ {f3iXn — ctj), where gi is a RO-ABP-polynomial that does not depend on 
Xi, and = ^ /3j = 0. Note that in this case, gi ^ 0, since otherwise a second order partial 
vanishes. Hence both ji and ki are certainly not equal to Xn- It must be that j3i ^ 0, since otherwise 
dx,?xi^dx^ = 0. Hence also / 0. 

Claim 3. Any gi is {X\{xj^ 

) Xki 7 Xn }) -pre- aligned. 

Proof. Assume that |yar(gj)| > 3, since otherwise the claim is trivial. Let h = g^ ■ {(3iXn — Oi). 
By Lemma [H h is Xfc-})-pre-aligned. Since /?, ^ 0, applying Corollary [J yields that gi is 

{X\{xj^ , Xk^ , x„})-pre-aligned. □ 
Now, let A = {f- : i e [k]}. Define for ^ A, = {i e [k] : = f-} and B., = {i [k] : 
7 7^^ and (fi)^^^^^ is not (X\{x„})-pre-aligned}. Note that "^^^j^ \E^\ = k. By Nearly Unique 
Nonalignment Lemma [TT| Y^^^j^ I-B7I < 2A;. Hence there exists 70 G A such that \Byg\ < 2|£'-yo|. 
Let / = £^70 U B^g, and let J = {ji : i e 1} U {ki : i e I}. We have that 2 < |J[ < 2|/| < 6|E-yJ. 
Observe that x„ J. Define for any z, fl = djfi. We have the following three properties: 

1. Each /j' is an (X\ J)-pre-aligned RO-ABP-polynomial, due to Lemma [8j 

2. For every i G /, f- = {(3iXn — ai)hi, where hi is a RO-ABP-polynomial. Namely, since 
ji, ki e J, fl = 5j\{j„fc,}[5'i(Ax„ - ai)] = {PiXn - ai) ■ dj\^j^^k,}9f 

3. In the above, each hi is an (X\(J U {x„}))-pre-aligned RO-ABP-polynomial. Namely, by 
Claim [3l gi is (X\{xj; , x^., Xn})-pre-aligned. Hence, using Lemma El we get that hi is an 
{X\{J U {x„}))-pre-aligned RO-ABP-polynomial. 

For any i, define /" = (f-)^^^^^^. Then we have the following three properties: 

1. yieE^,, /f ^0. 

2. Vi G -B-yg, f" = (/?i7o — Oii)hi, so f[' is an {X\{J U {x„}))-pre-aligned RO-ABP-polynomial, 
due to Proposition [H 
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3. For every i € [A;]\/, is X\{3;„}-pre-aligned. Since n ^ J, /f = = 

f^j[/|x„=7o]- So by Lemma El is an {X\{J U {x„,}))-pre-aligned RO-ABP-polynomial. 

Wlog. assume that J = {n + 1, n + 2, . . . , n — 2, n — 1}. Then | J| = n — 1 — n. Then 
Hie[k\fi = (^•/-fn)kn=7o = 70 • Pfi- Let X = {xi, . . . ,Xn}. We have found a representation of 
Pj^ as a sum of /c X-pre-ahgned RO-ABP-polynomials, where 7k < 7{k — \E^q\) < n — 7\E^q\ = 
n — 1 — Q\E^Q I + 1 — I -£'70 1 < n + 1 — \E^^^ | < n. This contradicts the induction hypothesis, and hence 
n <7k. □ 



8 A Vanishing Theorem and the PIT Algorithms 

The following theorem is analogous to Theorem 6.4 in [2]. 

Theorem 9. Suppose [F| > 3. Let {fi G F[X]}jg[y!,,] be a set of k X -aligned RO-ABPs. Let 
f = Eie[fc] fi- Then f = ^ /{^n^ = 0. 

We need to argue only the "<^" -direction. Assume that f\yv", = 0. 

We use induction on the number of variables n. The base case is when n < 7k. In this case it 
follows from Lemma [5] that / = 0. 

For the induction case assume n > 7k. We restrict one variable at a time. Consider a variable 
Xi, for I € [n]. Consider a restriction of the polynomials /j's and / to the subspace X£ = 0. 

By condition 2 in the definition of aligned, each of the restricted polynomials f- = fi\xi=o are 
{X \ {x4)-aligned. Let /' = ^ti fl- Clearly, = f'\ >V", = 0. Thus from the induction 

7k 

hypothesis, /' = f\x(=Q = 0, which implies that X£ divides /. Since i was arbitrarily chosen, this 
implies that P„ = Y[i=i divides /. But since / is multilinear, this gives / = c • P„ where c is a 
constant and P„ = HieM 

Thus c- Pn is the sum of k RO-ABPs which are also X-aligned (and therefore certainly X-pre- 
aligned). Since n > 7k, by Theorem [HI we can conclude that c = 0. Hence / = 0. □ 

Now we are ready to give the identity testing algorithms for S^-RO-ABP-polynomials given 
by {fi G The algorithm is simple. We use the fact that that Vf G F**, / = 

f{xi + vi,X2 + V2, . . . ,Xn + Vn) = 0. Assuming that we have some common alignment v for {fi\i^[k] , 
we know that each fi{xi + vi,X2 + V2, . . . ,Xn + Vn) is X-aligned. In this case. Theorem [9] is 
applicable, and it suffices to test if the polynomial evaluates to zero on the set W"^. Based on the 
three approaches to get a common alignment, the algorithms are as follows: 

1. {Non-black-box setting) By Corollary[3l we obtain a simultaneous alignment in time 0{k'^'nJ s). 
Then it takes rP'^^'> to test all points in W"^, so the running-time is 0{k'^ii7 s) + n'^^^h This 
proves Theorem m In this case we need |F| > kn?. 

2. (Semi-black-box setting) By Corollary HI we obtain a simultaneous alignment in time 
j^2^0(iogn) ^ Then it takes n'^^^) to test all points in W"^,, so the running-time is k'^n'^^^°^^^ -\- 
^O(k) ^ This proves Theorem O In this case we need |F| > kv? . 

3. [Black-box setting) In this case we only have black-box access to / = 'Ylielk] fi- Let 
fv{xi, . . . ,Xn) = f{xi -\- vi, . . . ,Xn + Vn) ■ Then it is easy to see that / = <^=^ \/v G 
Ak, fv\w^\ = 0. In this case the running-time is n'^(^°S''^+^) _ This proves Theorem [2j In this 
case we need |F| > kn^. 
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A Figure [3] 

Figure [3] shows an RO-ABP computing xiX2 + X2X^ + Xn-iXn, when n is even. The case when n is 
odd is dealt with similarly. Unlabeled edges are labeled with 1. 

B Example : RO-ABPs Are Not Universal 

Proposition 6. The degree-2 elementary symmetric polynomial en{xi,X2, . . . ,Xn) = 
Wi<i<j<n^i^j ' n > 3 can not be computed by a RO-ABP. 
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Proof. For the purpose of contradiction, suppose that some RO-ABP A computes e^- For any Xi 
denote the edge it labels by gi = (sj, ti). We can define an ordering < among g'j's, by taking gi < gj 
if and only if the polynomial computed by the subprogram A{ti,Sj) has a nonzero constant term. 
Due to the fact that A is a DAG, we have for any if Xi < Xj, then not Xj < Xj. 

The fact that for every pair, XiXj appears as a term in e„ implies that for any i ^ j, we 
have one of Xi < Xj or Xj < Xj. Incidently, note this implies the ordering is transitive. Namely, if 
Xi < Xj and Xj < Xk, then Sj must be reachable from ti, and must be reachable from tj in A, 
but then Si can not be reachable from tk- Hence not Xk < xj, which implies Xj < Xk- 

In any case, observe there is a permutation (j) : [n] ^ [n] for which < x^(^2) < • • • < 

x^(^n)- This implies that Ilieln] ^« appears as a term in the polynomial computed by A, which is a 
contradiction. □ 



C Non-Black-Box Testing a Single RO-ABP 

Consider a RO-ABP A. Denote the source and sink of yl by s and t, respectively. Suppose that Xi 
labels the edge (sj,ti). Wlog. assume that the order of variable layers in A is xi,X2, ■ ■ ■ ,Xn- We 
have the following easy proposition: 

Proposition 7. Suppose 1 < ii < i2 < • ■ ■ < ik ^ n. For a RO-ABP A, Xi-^Xi^ . . . Xi^. appears in 
A if and only if the constant terms in A{s, Si-^), A(ti^, Si^_^_^), for all m & [k — 1], and A(tk,t) are 
not zero. 

We build a directed graph Ga = {V, E) for RO-ABP A with vertex set V = {s, t, xi,X2, • • • , 
Edges are given as follows: 

1. (s, Xj), if the constant term in A{s, Si) is nonzero. 

2. (xj, t), if the constant term in A(ti, t) is nonzero. 

3. (xj,Xj), i < j, if the constant term in A(ti,Sj) is nonzero. 
We have the following corollary of Proposition [3 

Corollary 5. A{xi, . . . , x„) = if and only if t is not reachable form s in Ga- 

The algorithm for testing A is to construct Ga and to test connectivity. This can be done in 
time O(n^s), where s bounds the size of A. 
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